from sklearn_benchmarks.reporting.hpo import HPOReporting
import pandas as pd
pd.set_option('display.max_columns', None)
pd.set_option('display.max_rows', None)
reporting_hpo = HPOReporting(config="config.yml")
reporting_hpo.make_report()
fit¶We boostrap 10 000 times the hyperparameters optimization data points represented on the plot above. Then we compute the average cumulated time to reach a specific validation score by taking the mean across the bootstrapped samples. The shaded areas represent boostrapped quartiles. The fastest libraries are therefore the closest to the upper left corner. The specification of the HP grid can be found in the configuration file.
predict¶